The Use of Harr-like Features in Bubblegrams: a Mixed Reality Human-Robot Interaction Technique
نویسندگان
چکیده
We present the application of a vision algorithm based on Harr-like features in Bubblegrams a new mixed reality-based human-robot interaction (HRI) technique. Bubblegrams allows humans and robots working on collocated synchronous tasks to interact directly by visually augmenting their shared physical environment. Bubblegrams uses comics-like interactive graphic balloons or bubbles that appear above the robot’s body and allow intuitive interaction with the robot. Users wear light-weight mixed reality goggles that integrate displays and a camera, allowing the user to view and interact with the physical environment as well as with the virtual Bubblegrams interface linked to the robot’s body. In order to efficiently link Bubblegrams in real-time to the physical robot we implemented a vision algorithm based on Harr-like features which is the main topic of this paper. This paper briefly details the design of the Bubblegrams interface, the hardware and software we use for the current prototype, and the full details of the vision algorithm.
منابع مشابه
A Mixed Reality Approach to Human- Robot Interaction
This paper offers a mixed reality approach to humanrobot interaction (HRI) which exploits the fact that robots are both digital and physical entities. We use mixed reality (MR) to integrate digital interaction into the physical environment, allowing users to interact with robots' ideas and thoughts directly within the shared physical interaction space. We also present a taxonomy which we use to...
متن کاملSharing Spaces with Robots An Integrated Environment for Human-Robot Interaction
In this paper we offer an intelligent integrated environment for human-robot interaction. This environment takes advantage of the fact that robots are both digital and physical entities, thus improving human-robot interaction and communication. Using mixed reality, our approach brings digital information directly into the physical environment, allowing users to interact with robots’ ideas and t...
متن کاملImage flip CAPTCHA
The massive and automated access to Web resources through robots has made it essential for Web service providers to make some conclusion about whether the "user" is a human or a robot. A Human Interaction Proof (HIP) like Completely Automated Public Turing test to tell Computers and Humans Apart (CAPTCHA) offers a way to make such a distinction. CAPTCHA is a reverse Turing test used by Web serv...
متن کاملA Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction
Picking up objects requested by a human user is a common task in human-robot interaction. When multiple objects match the user’s verbal description, the robot needs to clarify which object the user is referring to before executing the action. Previous research has focused on perceiving user’s multimodal behaviour to complement verbal commands or minimising the number of follow up questions to r...
متن کاملAn Experimental Study on Blinking and Eye Movement Detection via EEG Signals for Human-Robot Interaction Purposes Based on a Spherical 2-DOF Parallel Robot
Blinking and eye movement are one of the most important abilities that most people have, even people with spinal cord problem. By using this ability these people could handle some of their activities such as moving their wheelchair without the help of others. One of the most important fields in Human-Robot Interaction is the development of artificial limbs working with brain signals. The purpos...
متن کامل